Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study
نویسندگان
چکیده
Abstract Recent advancements in open-domain question answering (ODQA), that is, finding answers from large corpus like Wikipedia, have led to human-level performance on many datasets. However, progress QA over book stories (Book QA) lags despite its similar task formulation ODQA. This work provides a comprehensive and quantitative analysis about the difficulty of Book QA: (1) We benchmark research NarrativeQA dataset with extensive experiments cutting-edge ODQA techniques. quantifies challenges poses, as well advances published state-of-the-art ∼7% absolute improvement ROUGE-L. (2) further analyze detailed through human studies.1 Our findings indicate event-centric questions dominate this task, which exemplifies inability existing models handle event-oriented scenarios.
منابع مشابه
Open-domain textual question answering techniques
Textual question answering is a technique of extracting a sentence or text snippet from a document or document collection that responds directly to a query. Open-domain textual question answering presupposes that questions are natural and unrestricted with respect to topic. The question answering (Q/A) techniques, as embodied in today’s systems, can be roughly divided into two types: (1) techni...
متن کاملA Neural Comprehensive Ranker (NCR) for Open-Domain Question Answering
This paper proposes a novel neural machine reading model for open-domain question answering at scale. Existing machine comprehension models typically assume that a short piece of relevant text containing answers is already identified and given to the models, from which the models are designed to extract answers. This assumption, however, is not realistic for building a large-scale open-domain q...
متن کاملA Comprehensive Resource to Evaluate Complex Open Domain Question Answering
We describe two corpora of question and answer pairs collected for complex, open-domain Question Answering (QA) to enable answer classification and re-ranking experiments. We deliver manually annotated answers to non-factoid questions from a QA system on both Web and TREC data. Moreover, we provide the same question/answer pairs in a rich data representation that includes syntactic parse trees ...
متن کاملOpen-domain question answering
Question answering aims to develop techniques that can go beyond the retrieval of relevant documents in order to return exact answers to natural language questions, such as “How tall is the Eiffel Tower?”, “Which cities have a subway system?”, and “Who is Alberto Tomba?”. Answering natural language questions requires more complex processing of text than employed by current information retrieval...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the Association for Computational Linguistics
سال: 2021
ISSN: ['2307-387X']
DOI: https://doi.org/10.1162/tacl_a_00411